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TECHNICAL FIELD 



The present invention relates to an image pick-up device. More 



specifically, it relates to an operation of matching frame rate of a 
first image signal of a variable frame-rate picked-up image and that of 
a second image signal supplied from an outside with each other and using 
10 these first and second image signals having this matched frame rate to 
generate a monitor image signal. 

BACKGROUND ART 



35 effects, scenes have been shot in condition where a shooting speed of 
a film camera, that is, the number of frames per second has been varied. 
For example, if a scene is shot at a higher speed than an ordinary one 
and reproduced at the ordinary speed, images are reproduced slowly. 
Therefore, fast motion of, for example, a water droplet falling into the 

2D water can be observed easily and in detail. If a scene is shot at a lower 
speed than the ordinary one and reproduced at the ordinary speed, on the 
other hand, fast motion of reproduced images can be seen. It is thus 
possible to enhance a sense of speed in a fight scene, a car chase scene, 
etc., thereby presenting images with an enhanced sense of reality. 

25 Further, in TV program making etc., while an attempt has been 

made to digitize processing of image pick-up, editing, delivery, etc. 
of a program, an attempt has been made to digitize processing in film 



In conventional filmmaking etc 



to obtain special video 
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making etc. also as fueled by an increase in image quality and a decrease 
in costs of equipment caused by progress in digital technologies. 

In a case where images are picked up by using an image pick- 
up device (video camera) due to digitization of filmmaking etc. , in order 

5 to obtain special video effects as described above, for example, not only 
an image signal obtained by image pick-up at a predetermined speed but 
also an image signal obtained by high-speed or low-speed image pick- 
up are all recorded in a recording device such as a server. Next, an 
image signal of frame images required to obtain the special video effects 

10 from these recorded image signals is read and subjected to image 
processing to generate an image signal with special video-effects. 

Further, to easily obtain special video effects such as fast 
reproduction and slow reproduction, an image pick-up device capable of 
varying a frame rate as disclosed in Jpn. Pat. Appln. KOKAI Publication 

15 No. 2000-125210 can be used to pick up images at a lower frame rate than 
a predetermined frame rate and reproduce them at this predetermined frame 
rate so that fast reproduction images may be obtained easily. By picking 
up images at a higher frame rate and reproducing them at the 
predetermined frame rate, slow reproduction images can be obtained 

2D easily. 

Generally, an image pick-up device is set so that when an image 
recorded in a recording medium such as a vide tape or an optical disc 
is reproduced by using a reproduction device and a reproduced image 
obtained from, for example, the reproduction device is displayed 
Z> together with a picked- up image on an electronic viewfinder or a monitor, 
which is an image display, and then the reproduced image and the 
picked-up image may be equivalent to each other in terms of picture 
quality, hue, etc. However, if a frame rate of an image signal generated 
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by an image pick-up device with a variable frame-rate and that of an image 
signal supplied from a reproduction device are different from each other, 
these two image signals cannot be synchronized with each other, so that 
the reproduced image and the picked-up image cannot be displayed 
5 simultaneously on the image display. 

DISCLOSURE OF THE INVENTION 

An image pick-up device related to the present invention 
comprises image signal generation means for generating a first image 

no signal of a variable frame-rate picked-up image, frame rate conversion 
means for matching a frame rate of the first image signal and a frame 
rate of a second image signal supplied from an outside with each other, 
and signal generation means for generating a monitor image signal by 
using the first image signal and the second image signal whose frame 

35 rates are matched with each other by the frame rate conversion means. 

In the present invention, the frame rate of the first image of 
a variable frame-rate picked-up image and that of the second image signal 
supplied from the outside are matched with each other. For example, the 
frame rate of the second image signal is converted into the frame rate 

2D of the first image signal. These first and second image signals whose 
frame rates are matched with each other are used to generate an image 
signal of an image in which an image based on the first image signal and 
an image base on the second image signal are mixed and output it as a 
monitor image signal. Further, these first and second image signals 

25 whose frame rates are matched with each other are used to generate an 
image signal in which a part of an image based on the first image signal 
is replaced by an image based on the second image signal and output it 
as the monitor image signal. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a diagram for showing a configuration of an image 
pick-up device; 

5 FIG. 2 is a diagram for showing a configuration of an image- 

signal-holding portion; 

FIG. 3 is a diagram for showing a relationship of the number of 
added frames and an image pick-up frame rate with respect to a variable 
frame rate; 

10 FIG. 4A is a diagram for explaining generation operation of an 

image signal DVb; 

FIG. 4B is a diagram for explaining the generation operation of 
the image signal DVb; 

FIG. 4C is a diagram for explaining the generation operation of 
35 the image signal DVb; 

FIG. 4D is a diagram for explaining the generation operation of 
the image signal DVb; 

FIG. 4E is a diagram for explaining the generation operation of 
the image signal DVb; 
20 FIG. 4F is a diagram for explaining the generation operation of 

the image signal DVb; 

FIG. 5A is a diagram for explaining an operation of a frame rate 
conversion portion; 

FIG. 5B is a diagram for explaining the operation of the frame 
25 rate conversion portion; 

FIG. 5C is a diagram for explaining the operation of the frame 
rate conversion portion; 
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FIG. 5D is a diagram for explaining the operation of the frame 
rate conversion portion; 

FIG. 5E is a diagram for explaining the operation of the frame 
rate conversion portion; 
5 FIG. 5F is a diagram for explaining the operation of the frame 

rate conversion portion; 

Fig. 6A is a diagram for showing an image example displayed on 
the basis of a monitor image signal; 

Fig. 6B is a diagram for showing another image example displayed 
ID on the basis of the monitor image signal; 

Fig. 6C is a diagram for showing a further image example 
displayed on the basis of the monitor image signal; 

Fig. 6D is a diagram for showing a still further image example 
displayed on the basis of the monitor image signal; 
15 Fig. 6E is a diagram for showing an additional example displayed 

on the basis of the monitor image signal; and 

Fig. 6F is a diagram for showing an additional image example 
displayed on the basis of the monitor image signal. 



2D BEST MODE FOR CARRYING OUT THE INVENTION 

The following will describe one embodiment of the present 
invention with reference to drawings. FIG. 1 shows a configuration of 
an image pick-up device. An image of a subject based on light entering 
through an image pick-up lens (not shown) is formed on an image pick-up 
Z> surface of an image pick-up element (not shown) that constitutes an image 
pick-up portion 11 in an image signal generation portion 10. The image 
pick-up element generates image pick-up charge for the subject image 
through photoelectric transfer and reads this image pick-up charge based 
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on a drive-and-control signal RC supplied from a drive portion 12 to 
convert it into a voltage signal. Furthermore, it supplies this voltage 
signal as a picked-up image signal Spa to an image-pick-up-signal- 
processing portion 13. 

5 The drive portion 12 generates the drive-and-control signal RC 

based on a control signal CT and a synchronization signal SYa that are 
supplied from a control portion 50 , which will be described later, and 
supplies it to the image pick-up portion 11. 

The image-pick-up-signal-processing portion 13 amplifies the 

10 picked-up image signal Spa and removes a noise component from it. 

Further, it converts this noise-free image signal into a digital signal 
and performs feedback clamp processing, flare correction, correction 
processing on a defect of the image pick-up element, process treatment, 
etc. to generate an image signal DVa. This image signal DVa is supplied 

15 to a frame-addition-processing portion 14 . It is to be noted that the 
signal processing performed by the image-pick-up-signal-processing 
portion 13 is set on the basis of the control signal CT supplied from 
the control portion 50, which will be described later. 

The frame-addition-processing portion 14 performs frame 

23 addition processing on the image signal DVa to vary a frame rate of the 
image signal DVa. This frame addition processing can be performed using 
a random access memory (RAM) . For example, to perform 3-frame addition, 
a first frame of the image signal DVa is stored in an RAM-1, the signal 
stored in which is read and added to a second frame of the image signal 

25 DVa and stored in an RAM-2. The sum signal stored in this RAM-2 is read 
and added to a third frame of the image signal DVa and stored in an RAM- 3 . 
The signal stored in this RAM- 3 thus makes a sum signal of the three 
frames of the image signal DVa, so that by reading this signal and 
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multiplying its signal level by (1/3), a required signal level is 
obtained. Further , a fourth frame of the image signal DVa is stored in 
the RAM-1, the signal stored in which is read and added to a fifth frame 
of the image signal DVa and stored in the RAM-2. The sum signal stored 

5 in the RAM-2 is read and added to a sixth frame of the image signal DVa 
and stored in the RAM- 3 . The signal stored in this RAM- 3 thus makes a 
sum signal of the three frames of the image signal DVa, so that by reading 
this signal and multiplying its signal level by (1/3) , a required signal 
level is obtained. Similarly, subsequent three frames of the image 

ID signal DVa are added up to sequentially generate an image signal having 
a required signal level. 

Further, if the signals thus sequentially generated are read at 
an predetermined output frame, an image signal DVb such that a picked-up 
image having a frame rate obtained by multiplying the frame rate of the 

15 image signal DVa by 1/3 is contained in the image signal having the output 
frame rate is given. 

It is to be noted that the frame addition processing can be 
performed also using a frame delay circuit. For example, the first frame 
of the image signal DVa is delayed by a period of two frames through the 

23 frame delay circuit and the second frame of the image signal DVa is 
delayed by a period of one frame through the frame delay circuit. These 
delayed first frame of the image signal and second frame of the image 
signal DVa are added to the third frame of the image signal DVa to obtain 
a signal in which the image signal DVa of three-frames is added. By 

25 reading this signal, as described above, at a predetermined frame rate 
in synchronization with, for example, a synchronization signal SYb 
supplied from the control portion 50 and then multiplying its signal 
level by (1/3) , an image signal DVb, which has a predetermined signal 
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level, such that a picked-up image having a frame rate obtained by 
multiplying the frame rate of the image signal DVa by 1/3 is contained 
in the image signal having the output frame rate can be obtained. 

By thus performing the frame addition processing, if a frame rate 

5 of the image signal DVa is, for example, "60P" (where the numeral 

indicates the number of frames per second and P stands for progressive 
signal, which holds true also with the other cases) and the number of 
added frames is two, an image signal that contains a picked-up image 
having a frame rate of "30P" can be obtained. If the number of added 

ID frames is four, an image signal that contains a picked-up image having 
a frame rate of M 15P" can be obtained. 

Furthermore, not only by changing over the number of added frames 
but also by controlling signal reading from the image pick-up element 
so as to vary the frame rate of the picked-up image signal Spa, the frame 

15 rate of the picked-up image can be varied continuously, thus generating 
the image signal DVb having the output frame rate in which a variable 
frame-rate picked-up image, which has been picked up at a desired frame 
rate, is contained. 

To vary the frame rate of the picked-up image signal Spa, the 

2D drive-and-control signal RC supplied from the drive portion 12 to the 
image pick-up portion 11 can be used to control a charge accumulation 
period, an image pick-up charge read timing, etc. at the image pick- 
up element, thereby obtaining the picked-up image signal Spa with the 
varied frame rate. Furthermore, by performing variation process on the 

25 image pick-up frame rate FRp by adjusting a length of a horizontal or 
vertical blanking interval on the assumption that the common data rate 
scheme (CDR: common sampling frequency scheme) is used, it is possible 
to generate such a picked-up image signal Spa that an image size in a 
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valid screen period does not change even if the image pick-up frame rate 
FRp is varied. Further, by using the CDR scheme, it becomes unnecessary 
to vary an operating frequency of each of the components that use the 
image pick-up frame rate FRp in accordance with the image pick-up frame 

5 rate FRp, thereby simplifying the configuration. 

In such a manner, the image signal DVb having an output frame 
rate generated by the frame-addition-processing portion 14 is supplied 
to a mix-processing portion 41, a wipe-processing portion 42, and an 
output selection portion 43 in a monitor image signal generation portion 

10 40 and a record-processing portion 61 in a recording-and- reproducing 
device 60. 

The record-processing portion 61 extracts an image signal of a 
variable frame-rate picked-up image from the image signal DVb supplied 
to itself. It further performs modulation processing, error correcting 

]5 code addition processing, etc. on the extracted image signal, to generate 
a record signal WS. It supplies this record signal WS to a recording 
head 62W to record a picked-up image in a recording medium 70. Further, 
it reads a picked-up image recorded in the recording medium 70 through 
a reproducing head 62R and supplies an obtained read signal RS to a 

2D reproduction-processing portion 63. The reproduction-processing 
portion 63 performs error correcting processing and demodulation 
processing and supplies an obtained image signal DVr to an input 
selection portion 21 of the image pick-up device. 

The input selection portion 21 is connected to an input terminal 

25 22, through which the image signal can be supplied. This input selection 
portion 21, based on an input selection signal SIE from the later- 
described control portion 50, selects either the image signal DVr 
supplied from the reproduction-processing portion 63 or an image signal 
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DVs supplied through the input terminal 22. Furthermore, it supplies 
the selected image signal as an image signal DVu to an image-signal- 
holding portion 31 in a frame rate conversion portion 30. Further, it 
supplies a write control portion 32 with a synchronization signal SYu 

5 extracted from the image signal DVu to be supplied to the frame rate 
conversion portion 30. 

The write control portion 32 in the frame rate conversion portion 
30 generates, based on the supplied synchronization signal SYu, a write 
clock signal CKW and a write control signal SEW which are used to write 

10 the image signal DVu to the image-signal-holding portion 31 and supplies 
them to the image-signal-holding portion 31. 

A read control portion 33 is supplied with the synchronization 
signal SYb from the control portion 50 and, based on this supplied 
synchronization signal STb, generates a read clock signal CKR and a read 

]5 control signal SER which are used to read an image signal written into 
the image-signal-holding portion 31 and supplies them to the image- 
signal-holding portion 31. 

FIG. 2 shows a configuration of then image-signal-holding 
portion 31. The image-signal-holding portion 31 writes the image signal 

23 DVu supplied from the input selection portion 21 into a memory and reads 
the image signal DVu written into this memory in synchronization with 
the image signal DVb. For example, three RAMs 312-a through 312-c are 
provided and a signal selector 311 is driven by the write control signal 
SEW, to sequentially allocate the image signals DVu to the RAMs 312- 

25 a through 312-c in frame units. Further, the write clock signal CKW is 
supplied to the RAM to which the image signal DVu is allocated, to store 
the allocated image signal DVu in the RAM. Further, the read clock signal 
CKR is supplied to the RAMs 312-a through 312-c to read the image signals 
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DVu stored in the RAMs 312-a through 312-c in synchronization with the 
image signal DVb. Furthermore, a signal selector 313 is driven by the 
read control signal SER to select the read image signals DVu in order 
in which they were allocated and supply them as an image signal DVw to 

5 the mix-processing portion 41, the wipe-processing portion 42, and the 
output selection portion 43. 

The mix-processing portion 41 generates an image signal DVmix 
of an image in which an image based on the image signal DVb and an image 
based on the image signal DVw are mixed and supplies it to the output 

ID selection portion 43. For example, the image signals DVb and DVw are 
added up and a resultant sum signal has its signal level halved, to 
generate the image signal DVmix. It is to be noted that a mix control 
signal from the control portion 50 might well be supplied to the 
mix-processing portion 41 to vary a mixing ratio between an image based 

15 on the image signal DVb and that based on the image signal DVw. 

The wipe-processing portion 42 generates an image signal DVwp 
of an image in which a part of an image based on the image signal DVb 
is replaced by an image based on the image signal DVw. For example, 
during the course of vertical scanning or horizontal scanning, the image 

23 signals DVb and DVw are switched with each other to generate the image 
signal DVwp. It is to be noted that a wipe control signal might well 
be supplied from the control portion 50 to the wipe-processing portion 
42 to vary timing for switching between the image signals DVb and DVw. 

Based on a monitor output selection signal ME from the control 

25 portion 50, the output selection portion 43 selects one of the image 
signals DVb, DVw, DVmix, and DVwp and outputs it as a monitor image signal 
DMTout. Further, to output the monitor image signal DMTout as an analog 
signal, the monitor image signal DMTout can be supplied to a D/A 
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conversion portion 44 so that the monitor image signal DMTout is output 
as the analog monitor image signal SMTout. 

To the control portion 50 , a user interface portion 51 is 
connected. When supplied with an operation signal PS in accordance with 

5 a user operation through this user interface portion 51, the control 
portion 50 generates the control signals CT etc. based on this operation 
signal PS, to control operations of each of the portions, thereby 
operating the image pick-up device in accordance with the user operation. 
Further, when supplied, through the user interface portion 51, with a 

10 frame rate set signal RSF which sets a frame rate of a picked-up image, 
the control portion 50 switches an image pick-up speed at, for example, 
an operation portion and, when supplied with the frame rate set signal 
RSF as the operation signal PS or with the frame rate set signal RSF from 
a remote-control device and external equipment, the control portion 50 

15 uses the control signal CT to control a frame rate of the picked-up image 
signal Spa to be generated by the image pick-up portion 11 or the number 
of added frames to be used by the frame-addition-processing portion 14 
based on the frame rate set signal RSF. Furthermore, based on the 
operation signal PS, it generates also the input selection signal SIE 

2D and the monitor output selection signal ME. Further, to generate the 
picked-up image signal Spa, it supplies the synchronization signal SYa 
to the drive portion 12. Further, to generate an image signal DYb, it 
supplies the synchronization signal SYb to the frame-addition- 
processing portion 14 and also supplies this synchronization signal SYb 

25 to the read control portion 33. Further, when the recording-and- 
reproducing device 60 is connected to the image pick-up device, it 
controls operations of the recording-and-reproducing device 60 based on 
the operation signal PS. 
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Next, operations of the image pick-up device will be described. 
A frame rate (variable frame rate FRc) of a picked-up image which is set 
by the frame rate set signal RSF can be varied continuously by changing 
over a frame rate (image pick-up frame rate FRp) of the picked-up image 

5 signal Spa which is generated by the image pick-up portion 11 and the 
number of added frames FA which is used by the frame-addition-processing 
portion 14 as described above. For example, as shown in FIG. 3, when 
the variable frame rate FRc is set into a range of "60P> FRO30P" by the 
frame rate set signal RSF, the number of added frames FA is set to "1" 

10 and the image pick-up frame rate FRp is equalized to the variable frame 
rate FRc. When the variable frame rate FRc is set into a range of 
"30P> FRO20P", the number of added frames FA is set to "2" and the image 
pick-up frame rate FRp is set to double the variable frame rate FRc. When 
the variable frame rate FRc is set into a range of "20P> FRc>15P", the 

15 number of added frames FA is set to "3" and the image pick-up frame rate 
FRp is set to triple the variable frame rate FRc. Subsequently, the image 
pick-up frame rate FRp and the number of added frames FA are changed over 
similarly. 

FIGS. 4A-4F each is diagram for explaining generation of the 
2) image signal DVb. For example, if the variable frame rate FRc is "18P", 
the image pick-up frame rate is "54P" and the number of added frames FA 
is "3". It is to be noted that FIG. 4A shows frames of the image signal 
DVa, FIGS. 4B, 4C, and 4D show operations of the RAM-1, RAM-2, and RAM- 3 
of the frame-addition-processing portion 14, respectively, and FIG. 4E 
25 shows frames of the image signal DVb. Further, an output frame rate, 
which is a frame rate of the image signal DVb, is set to, for example, 
"60P" to match equipment which is supplied with the image signal DVb. 
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At time point tl shown in FIGS. 4A-4E, when frame "Of" of the 
image signal DVa starts, the frame-addition-processing portion 14 sets, 
for example, the RAM-1 as a write RAM and stores the image signal DVa 
of frame "Of" in the write RAM. 

5 At time point t2, when a frame of the image signal DVb starts, 

the image signal of three frames are not completely added up yet, so that 
the image signal DVb is rendered of a blank frame. 

At time point t3, when frame "Of" of the image signal DVa ends 
and its frame "If" starts, the RAM-1 where the image signal of frame "Of" 

10 is stored is specified as an internal read RAM and the write RAM is 
changed over from the RAM-1 to, for example, the RAM-2. Furthermore, 
the signal stored in the internal read RAM, that is, the signal of frame 
"Of" stored in the RAM-1 is read and added to the image signal DVa of 
frame "If" by an adder and stored in the RAM-2, which is the write RAM. 

15 At time point t4, when frame "If" of the image signal DVa ends 

and its frame "2f" starts, to generate a three-frame sum signal, the 
RAM-2 in which the sum signal of frames "Of" and "If" is written is 
specified as the internal read RAM. Further, the write RAM is changed 
over from the RAM-2 to, for example, the RAM-3. Furthermore, the signal 

2D stored in the internal read RAM, that is, the signal stored in the RAM-2 
is read and added to the image signal DVa of frame "2f" by the adder and 
stored in the RAM-3, which is the write RAM. 

At time point t5, when frame "2f" of the image signal DVa ends 
and its frame "3f" starts, the three-frame sum signal obtained by adding 

25 up the image signal DVa of three frames is generated completely, so that 
the RAM-3 in which this three-frame sum signal is stored is specified 
as an external read RAM. Further, the RAM-1 is set as the write RAM, 
to store the image signal DVa of frame "3f" in the write RAM. 
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When the three-frame sum signal is generated and then a frame 
of the image signal DVb is timed to start, for example, at time point 
t6 when the frame of the image signal DVb starts, the three-frame sum 
signal is read from the external read RAM and has its signal level 

5 multiplied by (1/3) and is output as the image signal DVb. Further, the 
frame from which the image signal DVb is generated by reading the 
three-frame sum signal from the external read RAM is specified to be a 
frame of a valid image. It is to be noted if the three-frame sum signal 
is not completely written to the RAM yet or if a frame of the image signal 

ID DVb is timed to start when the three-frame sum signal is read completely, 
the image signal DVb of a previous frame is used repeatedly and so that 
frame is rendered an invalid image frame. In this case, in the image 
signal DVb, no blank frame is provided between the image signals of a 
picked-up image of each frame. 

35 Subsequently, by similarly using the RAM-1 through the RAM-3, 

the adder, etc. to add the signal DVa of three frames so that a 
three-frame sum signal may be generated and reading this three-frame sum 
signal at timing when a frame of the image signal DVb starts, it is 
possible to obtain the image signal DVb of an output frame rate in which 

2D a valid image is contained at the variable frame rate FRc. That is, as 
shown in FIG. 4E, it is possible to generate the image signal DVb 
containing a picked-up image that is valid at a desired variable frame 
rate of "18P", which is an output frame rate of "60P" that matches the 
external equipment. It is to be noted that FIG. 4F shows a flag EF that 

25 indicates whether a frame of the image signal DVb is of a valid image 
or an invalid image. 

The recording-and-reproducing device 60 extracts an image 
signal of the valid image from the image signal DVb by utilizing the flag 
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EF and records it in the recording medium 70. Further , when reproducing 
the recorded image signal , it is read at a reproduction frame rate 
different from that of the image signal DVb, for example, at a frame rate 
of "24P", to supply the image signal DVr having the reproduction frame 

5 rate to the input selection portion 21. By thus reproducing a signal 
recorded at a reproduction frame rate different from that of the image 
signal DVb, it is possible to obtain a picked-up image having a motion 
speed equivalent to that of an actual subject if the variable frame rate 
FRc is equalized to the reproduction frame rate. Further, if the 

10 variable frame rate FRc is set higher than a reproduction frame rate, 
it is possible to obtain a picked-up image having slower motion of the 
subject. If the variable frame rate FRc is set lower than the 
reproduction frame rate, on the other hand, it is possible to obtain a 
picked-up image having faster motion of the subject. 

15 The input selection portion 21 selects either the image signal 

DVr or DVs that has a fixed frame rate as the image signal DVu and supplies 
it to the frame rate conversion portion 30. The frame rate conversion 
portion 30 converts the frame rate of the image signal DVu into the image 
signal DVw synchronized with the frame rate of the image signal DVb. 

20 FIGS. 5A-5F explain operations of the frame rate conversion 

portion 30, for example, an operation where the frame rate of the image 
signal DVb is "60P" and that of the image signal DVu is "24P" as described 
above. It is to be noted that FIG. 5A shows frames of the image signal 
DVu, FIG. 5B shows an operation of an RAM222-1, FIG. 5C shows an operation 

Z> of an RAM 222-2, FIG. 5D shows an operation of an RAM222-3, FIG. 5E shows 
frames of the image signal DVw, and 5F shows frames of the image signal 
DVb. 
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At time point til shown in FIGS. 5A-5F when frame "FO" of the 
image signal DVu starts, the frame rate conversion portion 30 sets, for 
example, the RAM312-1 as a write RAM and supplies the image signal DVu 
to the write RAM using the signal selector 311, to store the image signal 
5 DVu of frame "F0" into the RAM222-1, which is the write RAM. 

At time point tl2 when a frame synchronized with the image signal 
DVb is timed to start, the image signal DVu of frame "F0" is not 
completely written yet, so that the image signal DVw is rendered as a 
blank frame. 

10 At time point tl3 when frame "F0" of the image signal DVu ends 

and its frame "Fl" starts, the RAM312-1 where the image signal of frame 
"F0" is stored is specified as a read RAM. Further, the write RAM is 
changed over from the RAM312-1 to, for example, the RAM312-2, to supply 
the image signal DVu to the write RAM using the signal selector 311 and 

35 store the image signal DVu of the next frame "Fl" into the RAM312-2. 

At time point tl4 when a frame of the image signal DVb is timed 
to start after the read RAM is specified, the image signal read from the 
read RAM is selected by the signal selector 313 and output as the image 
signal DVw. 

2D After that, at time point tl5 when frame "Fl" of the image signal 

DVu ends and its frame "F2" starts, the read RAM is changed over from 
the RAM312-1 to the RAM312-2 in which the image signal of frame "Fl" is 
stored. Further, the write RAM is changed over from the RAM312-2 to the 
RAM312-3, to store frame "F2" of the image signal DVu in the RAM312- 

25 3. 

Subsequently, by similarly writing the image signals DVu into 
the RAM312-1 through the RAM312-3 at its frame rate and reading these 
written image signals DVu from the RAM312-1 through the RAM312-3 



1 8 



according to an order of frames written at a frame rate synchronized with 
the image signal DVb, the image signal DVu can be converted into the image 
signal DVw having a frame rate synchronized with the image signal DVb. 

The mix-processing portion 41 can generate the image signal 
5 DVmix using the image signals DVb and DVw because these image signals 
DVb and DVw are synchronized with each other. Further , the wipe- 
processing portion 42 can generate the image signal DVwp using the image 
signals DVb and DVw because these signals DVb and DVw are synchronized 
with each other. 

10 Therefore, by controlling an operation of signal selection so 

that the image signal DVb may be output from the output selection portion 
43 as the monitor image signal DMTout or SMTout, it is possible to monitor 
a picked-up image. Further, by controlling the operation of signal 
selection so that the image signal DVw may be output as the monitor image 

35 signal DMTout or SMTout , it is possible to display a reproduced image 
obtained from the recording medium 70 or an image based on the image 
signal DVs input from the input terminal 22, on an electronic viewfinder 
or a monitor device. 

Furthermore, by controlling the output selection portion 43 so 

2D that the image signal DVmix may be output as the monitor image signal 
DMTout or SMTout, it is possible to appropriately set an image pick- 
up direction etc. so that the image picked-up subject may be located to 
a desired position after image synthesis. For example, to synthesize 
an image of the subject into a background image, the image signal DVr 

25 or DVs of the background image with a different frame rate is converted 
by the frame rate conversion portion 30 into the image signal DVw that 
has the same frame rate as the one the image signal DVb has and is 
synchronized with it. In this case, the picked-up image of the subject 
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is displayed as superimposed on the background image as the monitor 
image, so that it is possible to easily optimize the pick-up direction 
and a size etc. of the subject at the time of image pick-up. For example, 
a background image shown in FIG. 6A is picked up first and recorded in 

5 the recording medium 70 and then the image signal DVr of this background 
image is converted by the frame rate conversion portion 30 into the image 
signal DVw that is synchronized with the image signal DVb. 

Further, if a subject to be mixed into a background image is 
picked-up to generate the image signal DVb of a picked-up image shown 

10 in FIG. 6B, an image of FIG. 6C in which the subject is mixed into the 
background image is displayed on a screen of the electronic viewfinder 
or the monitor device. Therefore, using the image pick-up device capable 
of imaging the subject at a variable frame rate allows the subject to 
be picked up in condition where its size and position are matched with 

35 the background image, even if the frame rate of the image signal DVb and 
that of the image signal DVr are different from each other. 

Furthermore, by controlling the output selection portion 43 so 
that the image signal DVwp may be output as the monitor image signal 
DMTout or SMTout, it is possible to set the image pick-up device easily 

2D so that a picked-up image having luminance, hue, etc. equivalent to those 
of a previous picked-up image may be obtained. For example, the image 
signal DVr of a previous picked-up image shown in FIG. 6D is converted 
by the frame rate conversion portion 30 into the image signal DVw that 
is synchronized with the image signal DVb. 

25 Further, if the image signal DVb of a current picked-up image 

shown in FIG. 6E is generated, the previous picked-up image and the 
current one are displayed simultaneously on the screen of the electronic 
viewfinder or the monitor device as shown in FIG. 6F. Therefore, even 
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if an image pick-up device capable of imaging a subject at a variable 
frame rate is used, the image pick-up device can be set easily by 
comparing the two picked-up images to each other. 

Although, in the above embodiment, the image signal DVu has been 

5 synchronized in the frame rate conversion portion 30 with the image 
signal DVb of a picked-up image, the image signal DVb may be input to 
the frame rate conversion portion 30 to be synchronized with the image 
signal DVr or DVs so that the image signal DVmix or DVwp can be generated. 
However, if the image signal DVb is input to the frame rate conversion 

10 portion 30, a signal written at a frame rate of the image signal DVb is 
read at a frame rate of the image signal DVr or DVs, so that an image 
may be delayed when it is being picked up. Therefore, it is preferable 
to convert the frame rate of the image signal DVr or DVs and synchronize 
it with the image signal DVb. 

05 According to the present invention, the frame rate of the first 

image signal of a variable frame-rate picked-up image is matched with 
that of the second image signal from the outside, so that these first 
and second image signals having this matched frame rate are used to 
generate a monitor image signal. Therefore, it is possible to images 

2D having different frame rates on one screen simultaneously. 

Further, by thus matching the frame rate of the second image 
signal with that of the first image signal, it is possible to prevent 
signal delay due to frame rate conversion from occurring in the first 
image signal, thereby displaying a variable frame-rate picked-up image 

Z> without delay. 

Further, the first and second image signals are used to generate, 
as a monitor image signal, an image signal of an image in which an image 
based on the first image signal and an image based on the second image 
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signal are mixed, so that it is possible, for example, to superimpose 
an image being picked up on a background image etc. picked up beforehand 
and display it. Furthermore, the first and second image signals are used 
to generate, as a monitor image signal, an image signal of an image in 

5 which a part of an image based on the first image signal is replaced by 
an image based on the second image signal. Therefore, it is possible 
to easily adjust the image pick-up device in such a manner that when an 
image picked up already and an image being picked up are displayed on 
one screen simultaneously, the image being picked up may have luminance, 

10 hue, etc. equivalent to those of the already picked-up image. 



INDUSTRIAL APPLICABILITY 

As described above, an image pick-up device according to the 
present invention could well be applied to the case of displaying not 
15 only an image being picked up but also an image based on an image signal 
supplied from an outside on one screen simultaneously. 



